Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

1.2.307 hotfix 20240430 #20

Open
wants to merge 28 commits into
base: 1.2.307-opendal
Choose a base branch
from
Open

Conversation

yufan022
Copy link
Owner

@yufan022 yufan022 commented Apr 30, 2024

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

backport:
parquet meta load: databendlabs#15066
subquery: databendlabs#15019
predicate push down: databendlabs#14872
fix decimal subtraction is wrong: databendlabs#15304
fix COALESCE error in join sql: "select a.amount from xx.aa as a left outer join xx.bb as b ON ((a.xx = b.xx) where COALESCE(a.amount, 0) = 1" : databendlabs#15256

  • Fixes #[Link the issue here]

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Documentation Update
  • Refactoring
  • Performance Improvement
  • Other (please describe):

yufan022 and others added 28 commits April 16, 2024 16:28
* refactor: StringType::Scalar: Vec<u8> -> String

* fix substr, split, split_part

* fix storage convert to string

* fix build

* fix concat concat_ws

* fix variant functions

* fix stack overflow

* migrate regexp functions

* migrate 4 string function

* fix replace

* refactor: migrate some string funcs (databendlabs#14363)

migrate some string funcs

* fix replace

* fix string functions

* fix like, quote, instr

* fix

* fix domain

* optimize reverse

* optimize reverse

* improve to_bitmap

* fmt

* fix build

* add more

* fix strcmp

* fix clippy

* fix

* fix domain

* fix regexp_replace

* fix ascii

* fix regexp_instr

* simplify string domain

* add utf8 string tests

* fix clippy

* Fix scalar tuple

* Fix task dependency error

---------

Co-authored-by: baishen <[email protected]>
Co-authored-by: jw <[email protected]>
Co-authored-by: sundy-li <[email protected]>
Co-authored-by: Yijun Zhao <[email protected]>
)

* feat(query): support domain contains in string type

* feat(query): support domain contains in string type

* add random tests
* feat: support outer to inner join

* add tests;
* add non_equal_plan_forbidden

* add more random test

* move tests to databendlabs#14429

* Update src/query/sql/src/planner/optimizer/optimizer.rs

Co-authored-by: xudong.w <[email protected]>

---------

Co-authored-by: xudong.w <[email protected]>
* feat: support add session parameters during create task

* support to show and alter session parameters

* chore: add alter session parameter test
* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling
…labs#14455)

* chore: support mark join commutation

* fix tests

* fix left mark join

* fix broadcast join for mark join
* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling

* refactor(executor): refactor processor profiling
* chore: replace OneTable with DummyTableScan

* fix test
* support predicate move around

* fix typo

* fix: keep predicate order

* fix: MaterializedCte cannot be pulled up

* refine: make lint

* test: update tpcds join order

* fix: handle lateral join

* test: update parquet explain test

* test: update native explain test

* test: update tpcds join order sqllogictest

* fix: PullUpFilterOptimizer replace_predicate

* fix: refine agg index range equal

* test: update tpcds join order sqllogictest

* test: update parquet explain sqllogictest

* chore: remove useless code

* fix: keep predicates order

* test: update explain sqllogictest

* fix: improve agg index scalar compare

* feat: improve push down filter join

* merge

* test: update join order sqllogictest

* test: update tpcds join order sqllogictest

* feat: support infer equal condition

* test: update sqllogictest

* fix: filter push down scan

* test: fix sqllogictest

* fix: stable join conditions order

* feat: add DeduplicateJoinConditionOptimizer

* fix: large query test

* chore: refine code and add more comments

* chore: add more comments

* chore: make lint

* test: update explain sqllogictest

* test: update sqllogictest
* feat: support single join to inner join

* fix

* fix

* resolve conflicts

* clear code

* fix

* fix
* refactor pattern plan with Matcher

* fix

* save
* fix: runtime filters add to wrong table

* refine
…s#14525)

* support early filtering for more join types

* chore: fix need_unmatched_selection

* chore: refine code

* test: add more sqllogictest
* chore: refine left join

* chore: make lint
* chore: add table index to explain join

* resolve comment
* improve hash join code

* fix: from left single join to inner join

* chore: improve left join

* fix: right single to inner
* chore: optimized q17 join order

* add runtime filtert

* fix test

* fix test

* fix

* fix test

* rebase

* fix test

* fix test

* fix test

* try to fix test

* refactor
…databendlabs#14686)

* feat: enables the bloom runtime filter to be turned on adaptively

* fix

* refactor
* feat: improve push down filter join

* fix: reverse operator when (constant, column_ref)

* chore: add more test

* chore: complete sqllogictest

* fix: outer join push down

* chore: remove z3 and add new method

* chore: move

* chore: refactor try push down filter join

* chore: update sqllogictest

* chore: update sqllogictest

* chore: update sqllogictest

* chore: fix push down single join

* chore: update subquery

* fix: after join reorder don not push down

* chore: update native

* chore: improve can_filter_null

* chore: fix test

* feat: improve infer and / or filter

* chore: update native sqllogictest

* chore: update sqllogictest

* feat: add SingleToInnerOptimizer

* chore: remove after_join_reorder

* chore: fix outer join to inner join

* test: update parquet explain sqllogictest

* test: update native explain sqllogictest

* chore: make lint code

* chore: fix Cascades optimizer

* chore: add z3-prove

* chore: update sqllogictest

* chore: fix infer filter for outer join

* chore: update sqllogictest

* chore: update ee test

* chore: fix tpcds test

* chore: update sqllogictest

* chore: update ee test

* chore: fix distributed query plan

* chore: update sqllogictet

* chore: update test comment

* chore: add comments

* chore: make lint

* chore: update sqllogictest

* chore: suuport more join type

* chore: refine code

* chore: add semi / anti test

* chore: update sqllogictest

* chore: improve infer filter

* chore: update sqllogictest

* chore: add more comments and remove useless code

* chore: make lint

* test: update memo sqllogictest

* chore: update memo test

* chore: update ee test
* chore(planner): fix can_filter_null

* chore: handle remove_nullable

* chore: fix matches
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

10 participants